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\ Abstract 

We show how the nuclear medium affects the masses of the r] and r/' mesons. The change 

^ ■ should be easily detectable for dense matter and/or strong r]{ri')NN coupling. We also find 

Tlj" i that the r] — r]' mixing angle is less in magnitude in the nuclear matter than in vacuum. 
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A proper way of understanding the nature of the nuclear force is to study the interaction 
between nucleons and low-lying mesons. The nucleon mass gets shifted from its vacuum value of 
~ 938 MeV due to the radiative corrections generated by the scalar mesons inside the medium. 
This correction has been evaluated in different theoretical frameworks, e.g., the mean- field (MF) 
model and the relativistic Hartree (RH) model. In turn, the meson masses are affected by the 
nucleon propagators, modified due to the density- dependent contributions. 

The change of masses for the vector mesons p and uj and their mixing due to the nuclear 
medium have been widely investigated in the literature One of the advantages for such a treat- 
ment for vector mesons is the fairly well-established (but model-dependent) couplings between 
the meson and a nucleon-antinucleon pair p[, which leads to a more or less robust prediction. 
Among the pseudoscalar mesons, the coupling of pion to the nucleons can be evaluated from the 
Goldberger-Treiman relation, and is bound to be derivative in nature since vr is a Goldstone bo- 
son. Such a pseudovector coupling necessarily generates a small shift for the pion mass. On the 
contrary, little is known about the rjNN and rj'NN couplings. A fit to the one-boson exchange 
potential (OBEP) generates a value of a^(= g'^^j^/An) in the range of 3 to 7 p, whereas flavour 
SU(3) relations and chiral perturbation theory predict this quantity to be below 1 [Q. The value 
of a^/ is inferred to be between 0.25 and 0.75 from the pp scattering data. However, since r] 
and 7]' are much heavier, these couplings need not be completely pseudovector, and there can be 
sizeable pseudoscalar components. 

As we will show, such couplings introduce significant mass shifts for the 1] and 7]' mesons as 
well as a mixing between them, analogous to the matter- induced p — mixing discussed in 0. 
This result is valid even if the meson-nucleon coupling is an effective one generated through a 
vertex loop These shifts should be easily detectable in future hadronic colliders through the 
relatively clean channels rj — > 27, rj — ^ i~^i~'-f, rj' — >■ p°7, rj' — >■ wy, rj' 27 with a subsequent 
proper identification of and uj. The branching ratios for the above channels in vacuum are 
0.39, 5 X 10^3(3 X 10"^), 0.30, 0.03 and 0.021 respectively (for the second channel, the first 
number is for e"'"e~7 and the second one is for fi~^fi~'y) We will also show the behaviour of 
the matter-induced mixing angle as a function of nuclear density. The two-photon decay modes 
of both 7] and 77' are affected by the meson masses as well as the mixing angle and can in principle 
provide a clear testing ground for such density- dependent effects. 



The relevant part of the nuclear Lagrangian is 



(1) 



where we have neglected the pseudovector coupling, which has a small contribution on mass 
shift and mixing. A similar Lagrangian can be written for rj'. All the unknown factors, including 
those arising from an effective coupling generated by vertex loops, are dumped into g^^MN- 
The nucleon propagator in nuclear matter may be expressed as 

G{k) = GF{k) + GD{k) (2) 
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with £'*(|k|) = Y |kp + M*2, M* being the effective mass of the nucleoli in the medium. Since 
the main contribution to M* arises from the isospin bhnd a meson, M* = M*. The term Goik) 
arises from Pauh blocking and describes the modifications of the propagator at zero temperature 
by deleting the on-shell propagation of the nucleon in nuclear matter with momenta below the 
Fermi momentum kp- Since we will focus only on symmetric nuclear matter, k^ = kp] at this 
limit, 7r° does not mix with either t] or rj'. 

The radiative correction to the pseudoscalar mass can be written as 

- ^n(g2) = / ^(-l)Tr[75zG(fc + qHzG{k)] (5) 

where the negative sign is due to the fermion loop. Writing G = Gp + Gd, we see that the trace 
consists of four terms. Among them, the combination GE){k + q)G£,{k) does not contribute in the 
region in which we are interested, and the effect of the free part Gp^k + q)GF{k), being only a 
running of the coupling constant g^^NN 9riNN{.^^)i can be neglected since itself is quite small 
in the long- wavelength collective- mode region However, if one wants to see the collective 
mode over the entire region of q and go? the free part cannot be neglected; one needs a suitable 
subtraction procedure and the implementation of a momentum-dependent coupling. One can 
show that pseudovector couplings have a small contribution in the long- wavelength limit. 
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Figure 1: Variation of rj and rj' masses with coupling g^jMN (Qti'nn)- The upper set is for r]' 
while the lower one is for rj. The dot-dashed lines are for pj (nuclear density ratio) equal to 1 
whereas the short-dashed lines are for p/ po = 6. The horizontal solid lines indicate the vacuum 
masses. 

As we have seen, r] and rj' do not mix with tt*^ in the symmetric limit. The polarization can 
be written as a 2 x 2 matrix which is of the form 



— ~^ T ~7 9" 
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{Unr,' — ^n't))- The shifted masses are obtained from the solution of the following equation: 

{qo -^l- nw)(?o - - n„'„') - (n.rm'f = o. (7) 

Since the bare masses of rj and 77' are quite far apart, we neglect their decay widths. The 
matter-induced mixing angle 9mix is given by 

where m*^ = rri^ + 11^^, and same for rj' . 
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Figure 2: Variation ofrj and rj' masses with nuclear density. In both the figures, the upper set is 

for Vj and the lower set is for rj. The dot- dashed lines are without mixing while the short-dashed 
lines are with mixing. The horizontal solid lines indicate the vacuum masses. In the left-hand 
figure, g^^NN = 9r)'NN = 2 while in the right-hand figure, g^^NN = 4, gr^'NN = 3- 

Now let us discuss our results. In figure 1, we show the variation of meson masses with 
couplings gjjNN or gn'NN fo^^ two different densities. We note that the change is significant in 
the strong coupling limit even for ordinary nuclear matter, and for not-so-strong couplings in 
dense matter. This is without taking the mixing into account; as we will see, mixing enhances 



(8) 




the rj mass and reduces the i] mass. This behaviour is shown clearly in figures 2a and 2b; in 
figure 2a, the effect is shown for both S'^attv ^^id gr^i^^fq equal to 2, whereas in figure 2b, (/^jvjv = 4 
and QrfNN = 3. The range of gr,'NN is niore or less fixed from ref. 0, but QnNN can be larger 
(however, the one- loop Dyson equation approach has no meaning for a very strong coupling). 

Assuming both couplings to be positive, we show the plot of the mixing angle 9mix with 
nuclear density in figure 3. This angle always turns out to be negative, as the denominator in 
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Figure 3: Variation of rj — r]' mixing angle with nuclear density ratio. The dot-dashed line is for 
9r]NN = Qr^'NN = 2 and the short-dashed line is for g^j^N = 4, gn'NN = 3- 

eq. ^ contains a negative quantity, viz., m*^ — m*?. Thus, the vacuum mixing angle of t] and t]', 
inferred to be (—21.3 ± 1.5)° from the 77 decay mode 0, |TD[, gets reduced in nuclear matter. In 



other words, the medium tries to rotate 77 and rj' back to the gauge basis of rji and rjs. This is a 
prediction which should be testable in future colliders. The two-photon decay width depends on 



fn'^/jji and the mixing angle |T0|. Since both these quantities change in the medium, the decay 
width is affected in a nontrivial way. We show the two-photon decay width in figure 4. As can 
be seen, the effect is not very prominent for rj at weak coupling, but for rj', it should be easily 
detectable. To observe the effect for rj, one needs a strong g^jNN coupling as well as sufficiently 
dense nuclear matter. 

As we have said earlier, there are other clean channels to see the matter effects on 77 and 77', 
with p OT uj being detected in their leptonic channels. 



To conclude, we have shown how rj and 77' masses change in a nuclear matter, where we 
have assumed the presence of pseudoscalar couplings for both these mesons. The change is 
quite significant and should be easily detectable for large nuclear densities and/or strong meson- 
nucleon coupling. The mixing angle is found to be negative compared to the vacuum mixing 
angle, but smaller in magnitude than the latter. The ri{ri') — > 77 modes can shed more light on 
this issue. 
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Figure 4: Variation of two-photon decay widths of t] and rj' with nuclear density. The upper set 
is for rj' and the lower set is for rj. The dot-dashed lines are for g^j^ff = Qrj'NN = 2 and the 
short-dashed lines are for g^^N = 4, gn'NN = 3. The horizontal solid lines denote their decay 
widths in vacuum. 
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